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I .  INTRODUCTION . 

The  simple  fractional  flow  (or  Markov-type)  model  of  personnel  movements 
through  an  organization  has  been  widely  analyzed  (see  for  example  Bartholomew 
(1973),  Blumen,  Kogan  and  McCarthy  (1955),  Lane  and  Andrew  (1955),  Rowland  and 
Sovereign  (1969)  and  has  been  widely  applied,  especially  in  military  manpower 
planning  (see  U.S.  Navy  (1973)).   Other  models  such  as  the  "cohort"  and  "chain" 
models  (see  Marshall  (1973))  and  Grinold  and  Marshall  (to  be  published))  satisfy 
more  realistic  assumptions  on  personnel  movement,  but  lack  the  convenient  struc- 
ture of  the  Markov  model.   The  purpose  of  this  paper  is  to  present  an  extension 
of  the  Markov  Model  to  one  with  a  2-dimensional  state  space.   The  state  space 
is  chosen  so  that  the  fractional  flow  matrix  has  a  special  structure  which  is 
then  exploited. 

In  section  II  the  structure  of  the  model  is  presented  and  in  section 
III  examples  are  given.   In  section  IV  we  present  the  probabilistic  properties 
of  the  model  with  emphasis  on  computationally  tractable  formulae.   In  section 
V  the  structure  of  the  model  is  exploited  in  the  personnel  stock  and  flow 
equations. 

II.  STRUCTURE  OF  THE  FRACTIONAL  FLOW  MATRIX. 

We  assume  that  for  planning  purposes  an  organization  considers  time 
in  discrete  periods,  and  that  people  are  counted  at  the  end  of  each  period. 
When  counted,  a  person  is  assumed  to  possess  two  characteristics   i  and  j, 
and  is  said  to  be  in  state   (i,j),   where   i   represents  the  first  character- 
istic (FC),   1  s«  i  ^  n,   and  j   represents  the  second  characteristic  (SC), 
£(i)  s.  j  &  u(i).   Here   £(i)   and  u(i)   are  the  lower  and  upper  limits 
respectively  for  the  SC  when   i  is  the  FC.   Also  let  J(i)  =  {j|£(i)  sj  s  u(i)}, 

the  set  of  SC's  for  FC  i,   and  let  w.   be  the  number  of  elements  in  J(i). 

i 

Let   q.(j,m),   j,m  £  J(i)   be  the  fraction  of  people  in  state   (i,j) 
in  a  time  period  who  move  to  state   (i,m)   in  the  next  time  period,  and  let 


Q.   be  the  w.  x  w.   matrix   [q.(j,m)].   Let   p.(j,m),   j  £j(i),   m  €  J(i+1) 

be  the  fraction  of  people  in  state   (i,j)   in  a  time  period  who  move  to  state 

(i+l,m)   in  the  next  time  period,  and  let  P.   be  the  w.  x  w. , n   matrix 

1  1    l+l 

[p.(j,m)].   A  basic  assumption  of  our  two-characteristic  model  is  that  move- 
ment in  one  time  period  from  states  with  FC  i   can  only  be  to  states  with  FC 
i  or  i+1,   or  out  of  the  system.   Following  the  notation  of  earlier  papers, 
let  Q  be  the  fractional  flow  matrix  for  all  active  states  in  the  system. 
Then  Q  has  the  following  structure: 


Q  = 


Vl  Pn-1 


(1) 


n 
where  the  zero  matrices  have  been  suppressed.   Throughout  this  paper  we  assume 

that  people  can  leave  the  system  eventually  from  any  state  and  thus   (I-Q) 

has  an  inverse,  where   I   is  the  identity  matrix.   This  inverse   (I-Q)    is 

called  N,   the  fundamental  matrix  (see  Kemeny  and  Snell  (I960)).   For  each  i 

let  A.  =  (I-Q.-P.)l,  where   1  is  a  vector  with  every  element  equal  to   1. 

Then  A.   is  a  vector  of  w.   elements,  each  one  an  attrition  fraction  from 
l  i 

the  appropriate  state. 

III.   EXAMPLES. 

a)   The  LOS  Model. 

Let  the  "length  of  service"  that  a  person  has  completed  with  an  organ- 
ization be  denoted  LOS,  and  let  the  FC  of  a  person  denote  his  LOS.   If  the  LOS 
is  measured  in  the  same  time  units  as  the  planning  periods  then  each  Q.  matrix 
is  a  zero  matrix.   In  each  planning  period  a  person's  LOS  must  increase  by  one 
unit,  so  that  Q  has  the  structure 


Q  - 


1 

0 


2 
\ 
\ 

\ 

\ 

\ 


n-1 


By  appropriate  choice  of  the  second  characteristic   P.   often  has  special 
structure  too.   Consider  a  hierarchical  system  where  the  "rank"  or  "grade"  of 
an  individual  is  used  as  his  second  characteristic.   Then  the  structure  of 
each  P.   depends  on  the  organization's  promotion  scheme.   Assume  that  in  one 
period  a  person  either  stays  in  the  same  grade  or  is  promoted  one  grade.   No 

demotions  occur.   Then  P.   would  have  the  structure 

l 


x   x 

X    X 

\     \ 

\ 


p.  = 

1 


\ 


\ 


\ 


where  x  represents  a  non-zero  element. 

b)   The  (Grade,  LOS)  Model. 
If,  as  in  a)  no  demotions  occur,  and  only  single  promotions  can  occur 
in  a  time  period,  then  if  i   indexes  the  grade,  and  j   the  length  of  service, 
then  Q  has  the  structure  shown  in  (1) .   Each  submatrix  has  special  structure 
also.   Let 


1J 


pij 


probability  a  person  in  state   (i,j)   at  end  of  one  period 
will  be  in  state   (i,j+l)   at  the  end  of  the  next  period, 
probability  a  person  in  state   (i,j)   at  the  end  of  one 
period  will  be  in  state   (i+l,j+l)   at  the  end  of  the  next 
period. 


The  transition  matrix  Q.   has  non-zero  elements  only  immediately 
above  the  main  diagonal : 


Qi  = 


°   qi,*U) 


qi,£(i)+l 
0 


qi,u(i)-l 
0 


The  transition  matrix  P.   has  non-zero  elements  only  on  a  single 
diagonal  band.   If  A  (±+1)  ^  Jt  (±)  +1  and  u(i+l)  ^  u(i)  +  1,   then  P.   has 
the  form  shown  below,  where: 

1)  the  top  max  {0,1 (i+l)-(£(i)+l) }   rows  are  zeros, 

2)  the  last  max   {0,u(i+l)-(u(i)+l) }   columns  are  zeros. 


P.  = 

l 


Pi,Jl(i+l)-l 


Pi,£(i+1) 
0 


0   p.   ,.%   0  .  . .  0 
i,u(i) 


If   &(i+l)  ^  £(i),   the  first   £(i)+l-£(i+l)   columns  of  P   are  zeros.   If 
u(i+l)  ^  u(i),   the  bottom  u(i)+l-u(i+l)   rows  of  P.   are  zeros.   Under  any 
circumstances  P.   has  only  one  non-zero  diagonal,  and  we  call  such  a  matrix 
a  diagonal  matrix.   Efficient  methods  of  storing  and  multiplying  diagonal 
matrices  are  discussed  in  Hayne  and  Marshall  (1974). 

c)   The  (Grade,  TIG)  Model. 
In  certain  applications  a  person's  "time  in  grade,"  denoted  TIG,  is 
more  important  than  his  time  in  the  system  (LOS).   If  again  we  allow  no  demo- 
tions and  only  single  promotions  per  period  and  if  the  FC  indexes  the  grade 
and  the  SC  the  TIG  for  the  appropriate  grade,  then  Q  has  the  same  structure 
(1).   Each  Q.   has  the  same  structure  as  in  b) ,  but  now  £(i)  =  1   for  each 
grade   i.   However,  each  matrix  P.   has  a  single  column  of  non-zeros, 

~P.,       0      0 
ll 

P.  = 

l 

P.  ...        0      0 
_  i,u(i) 

since  promotions  to  the  next  highest  grade  lead  always  to  a  TIG  of  1.   Here 
p..   is  the  fraction  those  in  grade   i,  with  time  in  grade  i   equal  to   j, 
who  are  promoted  to  grade   i+1. 

If  demotions  are  not  allowed  and  only  single  promotions  can  occur  per 
period,  then  grade  is  a  characteristic  which  can  be  used  as  the  FC.   A  larger 
number  of  possibilities  occur  for  the  SC.   In  addition  to  those  above  some 
useful  ones  are  (i)  skill  category,  (ii)  physical  location  in  a  multi-location 
organization,  and  (iii)  educational  level.   Note  that  educational  level  could 
also  be  used  as  the  FC. 


IV.   SOME  PROBABILISTIC  PROPERTIES. 

Let  T.   be  the  set  of  states  associate  with  FC  i;   thus 

1 

T±  -  Ui,j)  I  J  £  J(i)>,     i  =  1,2,. ..,n. 

Also  let  w.  =  u(i)  -  &(i)  +  1,   the  number  of  states  in  T.   (and  J(i)). 
Finally  let  Tn  be  the  single  state  "out  of  the  system." 

In  this  section  we  develop  the  probabilistic  properties  of: 

1)  any  set  of  states  T. , 

2)  any  union  of  consequtively  indexed  sets  T., 

m 
i.e.    U  T  , 
i=k  X 

3)  the  union  of  all  transient  states,  which  we  call  T. 

One  of  the  purposes  of  this  development  is  to  show  that  the  stochastic  proper- 
ties of  Q,   typically  a  large  matrix,  are  readily  calculated  in  terms  of  the 

smaller  matrices  Q.   and  P.,   and  as  seen  in  section  III  these  often  have 

i        l 

extremely  simple  structure  which  leads  to  simple  computation. 

The  format  of  this  section  follows  closely  that  of  Chapter  3  of  Kemeny 
and  Snell  (1960).   The  notation  (K&S,3._._)  indicates  that  a  result  follows 
from  theorem  3._._  in  Kemeny  and  Snell,  albeit  usually  not  directly, 
a)   First-Order  Properties. 

Recall  that  we  assume  system  matrix  Q  has  a  fundamental  matrix 
N  =  (I-Q)   ,   and  each  element  of  N  is  the  expected  number  of  visits  to 
the  column  state  starting  from  the  row  state  (K&S,3.2.4).   Since  Q  has  the 
structure  shown  in  (1), 


N  = 


Nl   N1P1N2   N1P1N2P2N3 


N        N  P  N 
iN2        2  2  3 


N, 


n-1 

n   (N.P.)N  ' 

.  ,    i  i  n 
i=l 

n=l 

n   (N.P.)N 
.  0   l  l  n 
1=2 

n-1 

"   (N.P.)N 
i=3   i  i  n 


(2) 


where  N.  =  (I-Q.)   ,   i  =  l,...,n,   the  fundamental  matrix  for  FC  i.   Note 
that  the  large  matrix  N  is  completely  determined  by  the  matrices  N.   and 
P..   Thus  the  only  matrix  inversions  required  are  those  of   (I-Q.),   i  =  l,...,n. 
This  is  of  considerable  computational  significance  because  as  previously  men- 
tioned Q  is  usually  a  large  matrix. 

Each  matrix  N.   has  a  probabilistic  interpretation.   We  pursue  this 
interpretation  and  show  that  these  matrices  can  be  used  to  determine  other 
probabilistic  properties  of  interest. 

In  this  section  we  make  numerous  definitions  and  denote  the  k —  one 


by  Dk. 


Let  us  consider  first  the  properties  associated  with  a  single  set  of 


states  T.   and  define: 

i 

Dl.   v.(j,m)  =  expected  number  of  visits  to  state   (i,m)   given  that  FC  i 


D2.   V. 

l 


is  entered  in  state   (i,j), 
=  a  w.  x  w   matrix  having  v.(j,m)   as  the  element  in  row 
j-£(i)+l  and  column  m-£(i)+l. 


From  (2)  the  element  of  N.  in  row  j-£(i)+l  and  column  m-£(i)+l 
equals  the  expected  number  of  visits  to  state  (i,m)  given  that  FC  i  is 
entered  in  state   (i,j).   (K&S,3.2.4).   So,  from  definitions  Dl  and  D2 ,  we  have, 


V.  =  N..  (3) 

Note  that  the  rows  and  columns  of  N.   and  V.   correspond  to  states  in 

11 

T-     in  the  same  order  as  the  rows  and  columns  of  Q  . 
Now  define: 
D3.   T.(j)  =  expected  time  in  FC  i  given  that  FC  i   is  entered 

in  state   (i, j)  , 
D4.   t.    =  [t. (&(i)) T. (u(i))],  a  w.  x  l  vector. 

The  expected  time  spent  in  FC  i  equals  the  sum  of  the  expected  number  of 
visits  to  the  various  states  in  FC  i.   From  (3)  and  D3, 


r . ( j )  =  component  (j-£(i)+l)   of  N.l, 


and  from  D4, 

t.  =  N.l,   a  w.  x  1  vector,  (4) 

ill 

where   1  is  a  vector  with  all  components  equal  to  one. 

We  next  turn  our  attention  to  where  the  process  goes  when  it  leaves 
FC  i.   The  process  upon  leaving  T.   must  enter  either  T.  -  (if   i  <  n)   or 
T  .   Next  define 

D5.   b.(j,m)  =  probability  of  entering  FC  i+1   in  state   (i+l,m)   given 

that  FC  i   is  entered  in  state   (i,j), 
D6.   B       =  a  w.  x  w     matrix  having  b.(j,m)   as  the  element  in 

row  j-£(i)+l  and  column  m-£(i+l)+l, 
D7-   bi(j)   =  probability  of  ever  entering  T     given  that  FC  i  is 

entered  in  state   (i,j), 
D8.  b±  =  [b.(Mi) ),..., b.  (u(i))],   a  w.  x  1  vector, 


D9.   b._(j)   =  probability  of  never  entering  T     given  that  FC  i 
is  entered  in  state   (i,j), 
D10.  b±0     =  [bi0U(i)),...,bi0(u(i))]f   a  w±  *  1  vector. 

From  these  definitions  it  follows  that 

B.  =  N.P.,   a  w.  x  w.   matrix  (K&S.3.5.4),  (5) 

111       11 

b.  =  B.l,   a  w.  x  1  vector, 
11        l 

and 

b._  =  1  -  b. 
lO        l 

=  N.A.,   a  w.  x  1  vector. 
11       l 

The  matrix  B.   is  particularly  useful  in  manpower  policy  analyses. 

For  example  let   f.   be  a  1  x  w.   vector  of  the  number  of  people  entering 

T. .   Then  f.B.   is  a  1  x  w.,,   vector  of  the  number  of  these  people  who  will 
l  11  l+l 

eventually  enter  T.  _.   (K&S,3.3.6).   Such  applications  will  be  the  subject 
of  future  papers. 

Next  we  consider  the  first-order  properties  related  to  FC's   i  and 
k  where   i  £  k.   Define: 

Dll.   b((i, j) , (k,m))  =  probability  of  entering  FC  k  in  state   (k,m) 

given  that  FC  i   is  entered  in  state   (i,j), 
D12.   B  =  a  w.  x  w   matrix  having  b( (i, j) , (k,m) )   as  the 

element  in  row  j-£(i)+l  and  column  m-£(k)+l. 

From  definitions  D5  and  Dll  and  a  simple  conditioning  argument  we  have, 

u(i) 

b((i,j),(i+2,m))  =    I         b  (j,r)b    (r,m). 

r-A(i)   X      X  L 


So,  from  D12, 


B.  .,„  —  B.B_. 
i,i+2    l  1+2 


Notice  from  Dll  that  B. .   is  an  identity  matrix  and  from  D5  that  B.  .in  =  B. 

11  i,i+l    1 

More  generally  it  can  be  shown  that  for   i  £  k, 

k-1 

B.,  =  n  B  ,   a  w.  x  w,   matrix, 
lk        r       l    k 
r=i 

Define: 

D13.   v( (i, j ) , (k,m) )  =  expected  number  of  visits  to  state   (k,m)   given 

that  FC  i  is  entered  in  state   (i,j), 

D14.   V  =  a  w.  x  w   matrix  having  v( (i, j ) , (k,m) )   as  the 

IK  X      K. 

element  in  row  j-&(i)+l  and  column  m-£(k)+l, 
D15.   b.,  (j)         =  probability  of  ever  entering  FC  k,   given  that 

FC  i  is  entered  in  state   (i,j), 
D16.   b.k  =  [b.k(£(i) ),.-., b.k(u(i))],   a  w.  x  l  vector. 

Considering  each  row  of  B    as  the  part  of  an  initial  probability  vector 
that  applies  to  T,  ,  we  then  have, 


and, 


V   =  %-^\>      a     w.  x  w   matrix  (K&S,3.5.4),  (6) 

IK      IK  K.         IK 


b.,  =  B.,1,   a  w.  x  1  vector, 
lk    lk        l 


Define: 
D17.   t.,  (j)  =  expected  time  in  FC  k  given  that  FC  i  was  entered 

in  state   (i,j)  , 
D18'   Tik    =  ^Ut^Cl)),...,^^^)],   a  wk  x  l  vector. 

The  expected  time  in  an  FC  is  the  sum  of  the  expected  number  of  visits  to 
states  in  that  FC,  so 

t..  =  V.,1,   a  w.  x  1  vector, 
lk    lk        i 


10 


This  completes  our  study  of  the  first-order  properties  related  to  the 
various  FC's  of  the  system.   The  foregoing  definitions  by  no  means  exhaust 
the  first-order  properties  of  the  two-characteristic  model  that  might  con- 
ceivably be  of  interest.   It  is  felt,  however,  that  these  properties  will 
often  be  of  practical  interest  and  that  other  first-order  properties  may  be 
readily  derived  from  those  given  above. 

b)   Two  Special  Cases. 

The  elements  of  the  fundamental  matrix  for  FC   i,   N.   have  a  somewhat 

1 

different  interpretation  when  the  states  in  FC  i  have  what  we  call  the  "0-1 
visiting  property."  We  say  that  a  state  has  the  0-1  visiting  property  if 
the  state  can  be  visited  no  more  than  one  time.  Important  examples  of  two- 
characteristic  models  in  which  all  transient  states  have  the  0-1  visiting 
property  are  the  models  in  which  the  FC  or  SC  is  length  of  service  or  where 
the  SC  is  time  in  grade. 

If  each  state  in  T.   has  the  0-1  visiting  property,  then  the  expected 
number  of  visits  to  a  state  in  T.   is  equal  to  the  probability  of  visiting 
the  state.   The  element  of  N.   in  row  j-£(i)+l   and  column  m-£(i)+l  may 
then  be  interpreted  as  the  probability  of  visiting  state   (i,m)   given  that 
FC  i  is  entered  in  state   (i,j). 

Another  property  of  interest  is  the  "no  return  property."  We  say  that 
a  set  of  states  has  the  no  return  property  if  it  is  impossible  to  ever  make  a 
transition  into  the  state  after  a  transition  has  been  made  out  of  the  state. 
The  0-1  visiting  property  implies  the  no  return  property,  but  they  are  not 
equivalent.   For  example,  in  modelling  manpower  flows  in  the  U.S.  Civil  Service 
one  might  use  "GS  grade"  as  the  FC  and  "pay  step"  as  the  SC.   Each  state  is 
then  a  couple  (grade,  pay  step).   A  person  can  stay  in  the  same  pay  step  for 
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more  than  one  period,  so  if  there  are  no  demotions  then  each  state  would  have 
the  no  return  property  but  not  the  0-1  visiting  property. 

If  the  states  in  T.   have  the  no  return  property  then  it  is  possible 
to  order  the  states  in  T.   so  that  Q.   is  upper  triangular.   When  Q.   is 
upper  triangular  so  is   I-Q.   and  the  computation  of  the  inverse  of   I-Q., 
i.e.  the  fundamental  matrix  for  FC  i,   N. ,   is  considerably  easier  than  in 
the  general  case. 

If  the  states  in  T.   have  the  0-1  visiting  property,  then  not  only 
is  N.   upper  triangular  but  also  the  elements  of  N.   on  the  main  diagonal 
are  all  ones. 

c)   Variances. 

The  format  in  this  section  follows  closely  that  of  section  a) ,  but  here 
we  are  concerned  with  various  second  moment  properties  of  the  two-characteristic 
model. 

Define: 

D19.   v   .(j,m)  =  variance  of  the  number  of  visits  to  state   (i,m)   given 
z ,  1 

that  FC  i  is  entered  in  state   (i,j), 

D20.   V_  .      =  a  w.  x  w.   matrix  having  v_  . (i,m)   as  the  element 
2,i  11  &   2,i 

in  row  j-ft(i)+l  and  column  m-£(i)+l. 
Following  (K&S,3.3.3), 


V_  .  =  N.(2(N.).  -I)  -  (N.)   , 
2,1    l    i  dg        i  sq 

where  for  any  square  matrix  A,   A.   and  A    both  have  the  same  dimensions 

dg        sq 

as  A;   A    is  defined  when  A  is  square  and  is  formed  by  setting  all  elements 
in  A  not  on  the  main  diagonal  to  zero;  A    is  formed  by  squaring  all  the 
elements  in  A. 
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Define: 
D21.   x„  . ( j )  =  variance  of  the  time  spent  in  FC   i  given  that  FC  i 

L  ,  1 

is  entered  in  state   (i,j) 
D22.   t2  ±         =  [t2  iU(i)),...,x2  i(u(i))],   a  w±  x  i  vector. 


Following  (K&S,3.3.5), 


Define : 


t_  .  =  (2N.-I)t.  -  (t.)   . 
2,1      li     l  sq 


D23.   v„((i, j) , (k,m))  =  variance  of  the  number  of  visits  to  state   (k,m) 

given  that  FC   i   is  entered  in  state   (i,j), 

D24.   V~(i,k)         =  a  w.  x  w   matrix  having  v_ ((i, j) , (k,m))   as 

the  element  in  row  j-£(i)+l  and  column  m-£(k)+l, 

Following  (K&S,3.3.6), 


V2(i,k)  =  V.k(2(Nk)dg-I)  -  (V.k)sq. 

Define: 
D26.   T„((i,j),k)  =  variance  of  time  spent  in  FC  k  given  that  FC  i 

is  entered  in  state   (i,j), 
D27.   x2(i,k)     =  [x2((i,Jl(i)),k),...,T2((i,u(i)),k)],   a  w.  *  1 

vector. 
Following  (K&S.3.3.6), 

T2(i,k)  =  B.k(2Nk-I)Tk  -  (T.k)sq. 

If  each  state  in  T.   has  the  0-1  visiting  property,  then  the  diagonal 
elements  of  N.   are  equal  to  one,  and, 
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<Vdg  -  x> 

V2,l  "  Ni  "  (Vs,' 

v2(i,k)  =  v.k  -  (v.k)sq. 

d)   Matrices  of  t-Step  Transition  Probabilities. 
In  this  section  we  consider  the  probability  of  being  in  state   (k,m) 
t  steps  after  being  in  state   (i,j).   The  matrices  of  these  probabilities 
are  called  the  t-step  transition  matrices.   They  are  used  in  section  V  to 
represent  the  stock  vectors  as  a  sum  of  steady-state  and  transient  components. 
Define: 
D28.   m(t : (i, j) , (k,m))  =  probability  of  being  in  state   (k,m)   t  steps 

after  being  in  state   (i,j),   t  =  0,1,2,... 
D29.   M   (t)  =  a  w.  x  w   matrix  having  m(t ; (i, j) , (k,m) )  as  the 

element  in  row  j-£(i)+l  and  column  m-£(k)+l. 

The  rows  of  M.,  (t)   are  associated  with  states  in  T.  ;   the  columns  of  M..  (t) 
lk  1  lk 

are  associated  with  states  in  T.  . 

k 

We  have  immediately  that 

M. .(0)  =  I. 

n 

From  our  assumptions  on  the  structure  of  Q  we  have, 

M   (t)  =0   if   i  >  k, 

1 K. 

M   (t)  =0   if   t  <  k-i. 

If  the  process  is  to  be  in  state   (k,m)   exactly   t  steps  after  being 
in  state   (i,j),   then  it  must  be  in  some  state  with  FC  k  or  k-1  exactly 
t-1  steps  after  being  in  state   (i,j).   Conditioning  on  this  fact  leads  to  the 
recursive  equation, 

14 


Mik(t)  =  Mik(t-1)(>i +  Mi,k-l(t-1)pi-l'      c  =  1'2— •        (7> 

For  any   i  and  k   the  sum  over   t  of  the  probability  matrices  M   (t) 
gives  the  matrix  of  the  expected  number  of  visits  to  states  with  FC  k  start- 
ing from  states  with  FC  i.   So  we  have, 


(8) 


^  Mik(t)  =  Vik>     1  *  k' 
t=0  1K       lk 

=  0,       otherwise. 


Recall  that  the   Q   matrices  are  transient,  so  V  ,   is  matrix  of 

1  lk 

finite  elements.   This  implies  that, 


lim  M   (t)  =  0.  (9) 

t-Ko    1K 

From  (7)  it  can  be  shown  by  an  inductive  argument  that 

t-1 

I 
r=0 

The  t-step  transition  matrices  provide  a  rather  comprehensive  picture 

of  how  people  move  through  a  two-characteristic  system. 

e)   Conditioning  on  Promotion  When  the  FC  is  Grade. 
In  manpower  planning  one  is  often  interested  in  conditional  probabilities, 
e.g.  the  probability  of  attaining  grade  k  given  that  grade   i   is  attained. 
The  stochastic  properties  of  the  transient  matrix  Q  under  conditioning  on 
promotion  when  the  FC  is  grade  are  briefly  developed  in  this  section. 
Define: 


Mik(t)  ■  i  "i.k-i^-^k-X-  (10) 


D30.   (i,j;t)  =  the  event  "in  state   (i,j)   at  time   t" 

D31.   T       =  the  event  "a  transition  is  made  into  T,   before  leaving 
the  system." 
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Conditioning  on  the  event   T    is  the  same  as  conditioning  on  promotion  to 
grade  k. 

Define: 

D32.   q±(j,m)   =  Pr [ (i,ra; t+1) | (i , j ; t) ] 

D33.   qi(j,m)   =  Pr  [  (i,m;  t+1)  |  (i  ,  j  ;  t)  ,T±+;L] 

Provided  that  Pr [T    | (i, j ; t) ]  ±   0,   we  have  by  conditional  arguments, 

b.(m) 
q^j.m)  =  qi(j»m)  x  b      .  (11) 


Define: 

D34.   C.  =  a  w.  x  w.   matrix  having  the  elements  of  b.  (see  D8)  on  its 
111  i 

main  diagonal  and  zeros  elsewhere. 

We  assume  that  promotion  to  grade  i+1   is  possible  from  every  state 
in  T. .   Under  this  assumption  C.    exists.   If  promotion  to  grade   i+1  is 
impossible  from  some  state   (i,j)   then  we  must  avoid  conditioning  on  an 
impossible  event.   This  is  readily  accomplished  by  temporarily  treating  state 
(i,j)   as  part  of  T~   (out  of  the  system)  and  redefining  J(i),   Q.,   P.   and 
A.   accordingly. 

Define: 

*  * 

D35.   Q.   =  a  w.  x  w.   matrix  having   q.(j,m)   as  the  element  in  row 

j-&(i)+l  and  column  m-£(i)+l. 

Then  from  (11)  and  D34, 

*     -1 
Q.   =  C.  Q.C. . 
l     ill 

* 
The  matrix  Q.    is  the  matrix  of  within  grade  one-step  transition  probabili- 
ties conditioned  on  the  attainment  of  grade   i+1. 
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Define: 
D36.   Pi(j,m)   =  Pr[(i+l,m;t+l)|(i,j;t)] 
D37.   p*(j,m)   =  Pr[(i+l,m;t+l)|(i,j;t),T*+1] 

D38.   P        =  a  w.  x  w     matrix  having   p.(j,m)   as  the  element 
in  row  j-£(i)+l  and  column  m-£(i+l)+l. 


We  then  have, 


*  1 

Pi(j,m)  =  P1(j,m)  x  b      . 


1 

Thus   from  D34   and  D38, 

*  -1 

P.    =  C.    P.. 
l  11 

* 
The  matrix  P.    is  the  matrix  of  one-step  promotion  probabilities  conditioned 

on  the  attainment  of  grade  i+1. 

Because    (Q.)r  =  cT^C, 
i      ill 

the  fundamental  matrix  for  grade   i  when  we  condition  on  promotion  to  grade 

i+1  is 

*       *  -1 
N.  =  (I-Q.) 


Z75 
(Q,) 
r=0 


*\r 

i' 


=  I  cTVc 

r=0  X  X   X 

=  cT1  N.C. . 
1   11 

Define : 

D39.   v.(j,m)   =  expected  number  of  visits  to  state   (i,m)   given  that 

grade   i   is  entered  in  state   (i,j)   and  grade   i+1   is 

attained. 
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D40.   V.       =  a  w.  x  w.   matrix  having   v.(i.m)   as  the  element  in 
1  11  °    1  J 

row  j-£(i)+l   and  column  m-£(i)+l 
D41.   b.(j,m)   =  probability  of  entering  grade   (i+1)   in  state   (i+l,m) 
given  that  grade   i   is  entered  in  state   (i,j)   and 

grade   i+1  is  attained. 

*  * 

D42.   B.       =  a  w.  x  w.,.,   matrix  having   b.(i.m)   as  the  element 
i  i    l+l  °    i  J 

in  row  j-£(i)+l  and  column  m-£(i+l)-l. 

Then  one  may  show  that, 

*    * 

V.  =  N., 
l    l 

and 

*    *  * 

B.  =  N.P. 
l    11 

=  c7V . 

1  1 

Note  that  B.    is  simply  B.   with  its  rows  normalized,  but  Q.    is  not 
11  l      

simply  a  row  normalized  form  of  Q.. 

As  with  the  matrices   B.,   products  of  matrices   B.   with  successive 

l  l 

indices  are  well  defined:   their  meaning  is  that  of  a  matrix  B.,   as  defined 
in  Dll  and  D12  with  conditioning  on  attainment  of  grade  k. 

The  conditioned  and  unconditioned  matrices  may  be  used  together.   For 
example,  the  elements  of   B.B     give  the  probabilities  of  entering  grade 
i+2  in  the  column  state  conditioned  on  starting  from  the  row  state  in  T. 
and  eventually  attaining  grade  i+2. 

V.   EQUATIONS  OF  STOCKS  AND  FLOWS. 

We  begin  by  defining  the  terms  "stocks"  and  "flows,"  and  then  discuss 
why  stocks  and  flows  are  important  in  manpower  planning  models.   Next  the 


18 


relations  between  stocks  and  flows  in  a  two-characteristic  model  are  developed, 
Finally,  we  show  how  the  stocks  can  be  represented  as  the  sum  of  a  "steady- 
state"  component  and  a  "transient"  component. 

a)   Definitions  and  Background. 
A  period  is  the  interval  of  time  from  immediately  after  an  integer 
value  of  the  time  parameter   t   up  to  and  including  the  next  integer  value  of 
t.   A  period  is  identified  by  the  value  of  the  time  parameter  at  the  end  of 
the  period.   Thus, 

period  t..  =  {t:   L-l  <  t  S  tj 

where   t   is  an  integer. 

The  number  of  people  in  a  state  at  the  end  of  a  period  is  referred  to 
as  the  "stock"  in  that  state.   Thus,  stocks  are  counted  only  at  integer  values 
of  the  time  parameter  t. 

The  number  of  people  who  change  their  status  in  the  system  from  one 
state  to  another  during  any  period  is  referred  to  as  a  "flow."   Flows  occur 
during  a  period,  but  we  do  not  specify  the  exact  time  at  which  they  occur. 

Stocks  and  flows  are  of  primary  importance  in  most  manpower  planning 
models.   The  most  obvious  reason  for  this  is  that  costs  are  closely  related 
to  stocks  and  flows,  e.g.  total  payroll  depends  on  stocks,  transportation 
costs  or  retraining  costs  depend  on  flows.   Recruiting  policy  and  promotion 
policy  depend  in  the  short  term  on  present  stocks  and  in  the  long  term  on  how 
we  model  future  stocks  and  flows.   Determining  the  feasibility  of  a  retirement 
plan  and  evaluating  the  effects  of  a  change  in  billet  structure  are  other 
instances  in  which  the  planner  needs  to  be  able  to  model  stocks  and  flows  in 
a  manpower  system. 
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We  now  define  the  variables  that  are  used  to  model  the  stocks  and 

flows  in  the  two-characteristic  model.   Recall  that  T.   is  the  set  of  states 

1 

associated  with  FC  i,   w.   is  the  number  of  states  in  T.,   and  for  conven- 

1  1 

ience  of  notation  we  assume  the  second  characteristic  takes  on  successive 
integer  values  for  FC  i. 

In  a  Markov  model  the  stocks  and  flows  are  in  general  random  variables. 
In  this  section  we  deal  only  with  the  expected  values  of  stocks  and  flows. 
Such  a  model  is  called  a  "fractional  flow  model"  because  the  transition  proba- 
bilities of  the  Markov  model  are  in  effect  treated  as  fractions  which  direct 
flows  through  the  system  in  a  deterministic  manner. 

Let, 

s..(t)  =  expected  stocks  in  state   (i,j)   at  time   t, 

Si(t)   =  (Sis£(i)(t)-->Si,u(i)(t))> 

a  1  x  w.   vector  of  expected  stocks  in  T., 
l  l 

s(t)   =  (s  (t),...,s  (t)), 
±         n 

n 

a  1  x   T  w.   vector  of  expected  stocks  in  the 

i=l   X 

system. 

By  our  basic  assumption,  flows  into  any  state  in  T.   must  come  from  a 

state  in  either  T.   or  T.  .,  .   We  also  make  provision  in  our  model  for 
l       l-l 

"external  flows."  The  source  of  such  flows  is  unspecified.   However,  we  may 
consider  external  flows  as  consisting  of  people  hired  into  the  system.   The 
external  flows  may  be  deterministic  or  random,  but  we  deal  only  with  their 
expected  values. 
Let, 
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d..(t)  =  expected  flow  from  states  in  T.   to  state   (i,j) 
during  period   t,   a  scalar; 

di(t)   =  (di,£(i)(t)"-"di,u(i)(t))'   a   1Xwi  Vect0r; 
f..(t)  =  expected  external  flow  into  state   (i,j)   during 

period   t,   a  scalar; 
fi(t)   =(fM(i)(t)'-'fi)U(i)(t))'   a   ixw.   vector; 
g.  .  (t)  =  expected  flow  from  states  in  T.     to  state   (i,j) 

during  period  t,   a  scalar; 

8i(t)   =(gi,i(i)(t)"--'8i,u(i)(t))'   a  1  x  w.   vector. 
When  i  =  1,   g..(t)   is  defined  to  be  zero. 

The  relation  between  the  flow  vectors  and  the  stock  vector  in  grade  i 
is  depicted  in  Figure  1  where  "T. ;t"  denotes  the  states  with  FC  i  at  time 
t. 


s.(t) 


Figure  1.   Stocks  and  Flow  with  FC   i   in  Period   t 
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b)   Basic  Stock  Equation. 
Clearly,  from  our  assumptions, 


s.(t)  =  d.(t)  +  f.(t)  +  g±(t) 


(See  Figure  1.) 

It  will  be  convenient  to  define, 

s  (t)  =0,   a  vector  of  zeros, 
P_    =0,   a  matrix  of  zeros. 
Using  conditional  expectation  we  then  have 

d±(t)  =  si(t-l)Q1,         i  =  l,...,n, 

g±(t)  =  s1_1(t-1)pi_1»     ±  =   li...»n. 
The  basic  stock  equation  is  then, 

s.(t)  =  s.(t-l)Qi  +  f±(t)  +  si_1(t-DPi_1,     i  =  l,...,n.     (12) 

The  basic  stock  equation  for  FC  i  can  be  written  in  terms  of  the 
expected  or  actual  stocks  with  FC  i   in  previous  periods.   By  recursively 
applying  the  basic  stock  equation  for  s . (t) ,s . (t-1) , . . . ,s. (1)   one  obtains 

t-1  t-1 

s.(t)  =  s.(0)Q.  +  I      f.(t-r)Qr  +  I      s.    .(t-r-l)P.  .(£, 
l       l    l    Ln      l      l    Ln     i-l        l-l  l 
r=0  r=0 

t  =  0,1,2,...,  (13) 

i  =  1, . . . ,n, 

which  we  will  refer  to  as  the  cumulative  stock  equation. 

Equations  (12)  and  (13)  are  used  frequently  in  the  remainder  of  this 
paper.   Some  manpower  models  used  in  the  U.S.  military  for  short-range  fore- 
casting consist  principally  of  an  application  of  an  equation  similar  to  (12) . 
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c)   Transient  Properties  of  the  Stocks. 
In  this  section  we  develop  a  method  for  expressing  the  stock  vector 
as  a  sum  of  a  "steady-state"  component  and  a  "transient"  component.   This 
method  helps  one  to  understand  how  the  stock  vectors  change  in  going  from 
any  present  stock  vector  to  future  stock  vectors.   This  method  also  helps 
one  interpret  the  character  of  the  limiting  stock  vector. 

We  do  not  want  to  restrict  ourselves  to  cases  in  which  the  stock  vector 
converges  (as   t   increases)  to  a  finite  vector.   We  say  that  the  vector 
function  s.(t)   is  a  steady-state  component  of  the  stock  vector  s.(t)   if, 

lim  (s.(t)-s. (t))  =  0. 

For  any  sequence  of  stock  vectors  <s.(t)>   there  is  more  than  one  choice  of 
the  steady-state  component.   In  applications  one  would  prefer  a  steady  state 
component  having  a  relatively  simple  mathematical  form.   We  show  that  in  some 
cases  a  judicious  choice  of  s.(0)   makes  this  possible.   The  following  theorem 
shows  the  properties  of  a  class  of  steady-state  components  which  are  quite 
useful. 

Theorem.   For  any  collection  of  1  x  w.   vectors   s.(0),   i  =  l,...,n, 
let  the  vector  functions   s.(t)   satisfy 

?  (t)  =  sjL(t-l)Q1  +  f±(t)  +  si_1(t-l)Pi_1,     t  =  1,2,..., 

i  =  1,  .  .  . ,n, 

i.e.  the  vector  functions   s.(t)   satisfy  the  basic  stock  equation  (12).   Then 

(a)   the  actual  stocks  at  time   t  are 

i 
s.(t)  =  s.(t)  +  I      (sk(0)-sk(0))Mk.(t), 


k=l 
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00  1 

(b)  I      (s  (t)-s  (t))  =  I      (s  (0)-~,(0))B,  N., 
t=0   x    X      k=l   k    k    kl  x 

a   1  x   w.   vector  having  finite  components, 

(c)  s.(t)   is  a  steady-state  component  of  the  stock  vector  s.(t),   i.e. 

lim  (s.  (t)-s'.  (t))  =  0. 
t-x» 

Before  proving  the  theorem  we  explain  why  one  might  be  interested  in 

a/ 
such  a  theorem.   Part  (c)  of  the  theorem  says  that   s.(t)   is  a  steady-state 

component  of  the  stock  vector  s.(t),   and  part  (a)  shows  how  the  stock 
vector  s.(t)   can  be  expressed  as  the  sum  of  a  steady-state  component  and  a 
transient  component.   Part  (b)  of  the  theorem  says  that  the  total  over  all 
periods  of  the  difference  between  the  stock  vector  and  its  steady-state  com- 
ponent is  a  readily  calculated  finite  vector. 

Such  information  can  be  useful  when  long-range  planning  has  been  done 
using  an  "equilibrium  model."  As  an  example  consider  an  organization  which 
intends  to  change  from  its  present  size  of  250,000  to  a  size  of  200,000.   The 
manpower  planner  may  use  an  equilibrium  model  to  develop  policies  that  are  in 
some  sense  optimal,  and  these  policies  will  maintain  the  size  of  the  organiza- 
tion at  200,000  people  once  the  organization  has  been  reduced  to 
this  size.   So  the  equilibrium  model  tells  the  planner  what  to  do  once 
the  size  of  the  organization  reaches  the  desired  equilibrium  level  but  it 
doesn't  tell  him  how  to  change  the  organization  from  its  present 
level  (250,000)  to  the  desired  equilibrium  level  (200,000).   This  problem  of 
finding  an  optimal  transition  policy  to  go  from  present  stock  levels  to  a  future 
equilibrium  stock  distribution  is  a  very  difficult  one  (see  Chapter  4  ,  Bartho- 
lomew (1973)).   One  method  for  making  the  transition  is  to  immediately  implement 
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the  hiring,  promotion  and  attrition  policies  that  have  been  derived  from  the 
equilibrium  model.   Because  of  the  transient  nature  of  the  system  these  policies 
will  eventually  bring  the  stocks  in  the  system  to  their  equilibrium  levels. 

In  the  theorem  the  vector  functions   s.(t)   play  the  role  of  what  the 
stocks  would  be  at  time   t   if  the  system  were  in  equilibrium.   The  stock 
vectors   s.(t)   indicate  what  the  stocks  will  be  at  time   t   if  we  start  with 
the  present  stocks   s.(0)   and  implement  the  policies  of  the  equilibrium  model 
(which  are  reflected  in  the  external  flows,   f.(t),   and  the  transition  matrices 
Q.,   P.   and  A.).   From  part  (a)  of  the  theorem  we  may  readily  calculate  the 
difference  between  actual  stocks  and  equilibrium  stocks  in  any  grade  and  any 
period.   If  there  is  a  penalty  associated  with  having  more  people  than  the 
equilibrium  stocks  in  the  system,  then  part  (b)  of  the  theorem  may  be  used  to 
calculate  the  total  penalty.   Part  (c)  of  the  theorem  assures  the  planner  that 
the  difference  between  the  actual  and  equilibrium  stocks  does  converge  to  a 
zero  vector  as  the  time  parameter   t   increases. 

The  proof  of  the  theorem  follows. 

Proof.   By  hypothesis  the  vector  functions   s.(t)   satisfy  the  basic  stock 

equation  (12),  so  they  must  also  satisfy  the  cumulative  stock  equation  (13): 

t-1  t-1 

»  (t)  =  s  (0)Qj  +  I      f.(t-r)Qj  +  I     b    (t-T-l)P   <£. 

r=0  r=0 

Of  course  the  stock  vectors   s.(t)  also  satisfy  the  cumulative  stock  equation 

(13) ,  so  we  have, 

t-1 
s  (t)  -  s.(t)  =  (s.(0)-7i(0))Qj  +  I      (si_1(t-r-l)-si_1(t-r-l))P._1Qi. 

r=0 

When   i  =  1   this  implies, 
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Sl(t)  =  s^Ct)  +  (s1(0)-s'1(0))Qj 

1 
=  ^(t)  +  I      (sk(0)-~k(0))Mka(t), 

so  we  have  shown  that  part  (a)  of  the  theorem  is  true  when  i  =  1.   Suppose 
part  (a)  of  the  theorem  is  true  for  grade   i-1,   i.e. 

■i_l(t)  "  •!-!<*>  +  I     V»-!k(0))\,i-lW' 

k=l 

Then, 

i-1 
s._1(t-r-l)-7._1(t-r-l)  =  I      (sk(0)-sk(0))Mk  i_1(t-r-l), 

iC~X 

and 

t-1  i-1 
s.(t)  -  s±(t)  =  (si(0)-s±(0))Qj  +  I       I      (sk(0)-sk(0))Mk  i_1(t-r-l)Pi_1Q^ 

r=0  k=l  ' 

i-1  t-1 

=  (si(0)-s.(0))Q^  +  I      (sk(0)-sk(0))  I     ^  ^^t-r-DP^ 

k=l  r=0    ' 

From  equation  (10)  in  Section  IV 

r=0 

so  we  have  shown  by  induction  that, 

i-1 
s.(t)  -  s±(t)  =  (s.(0)-s.(0))Q^  +  I      (sk(0)-7k(0))Mk.(t). 

k=l 

This  proves  part  (a)  of  the  theorem. 
From  part  (a) , 

00  °°   i 

1  (s  (t)-s  (t))  =  I        I      (s  (0)-s  (0))11  (t) 
t=0  X  X      t=0  k=l   k     K     kl 

=  I      (s  (0)-s  (0))  I     ^  (t) 

k=l   k    k    t=o  R1 
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■  J,    <«k«»-«k«»>BklH1. 

k=l 

a  1  x  w.   vector  having  finite  components. 
The  last  step  above  follows  from  equations  (6)  and  (8)  of  Section  IV.   This 
proves  part  (b)  of  the  theorem. 

Part  (c)  follows  from  the  fact  that  the  sum  in  part  (b)  is  finite,  and 
the  proof  of  the  theorem  is  complete. 

The  utility  of  this  approach  depends  on  our  ability  to  find  vectors 
s.(0)   such  that  the  vector  functions   s.(t)   are  simple  and  readily  calculated. 
Some  examples  follow. 

1.   Fixed  External  Flows. 

The  equilibrium  models  previously  mentioned  enjoy  some  popularity  in 
military  manpower  planning  in  the  United  States  (see  for  example,  RAND  Corpora- 
tion (1973)).   The  rationale  underlying  the  use  of  such  models  is  that  one 
should  determine  the  organization  structure  and  the  policies  to  maintain  this 
structure  which  are  optimal  (or  "least  infeasible11) .   Among  the  policies 
derived  from  an  equilibrium  model  is  the  hiring  policy.   This  has  the  form, 


f±(t)  =  f±,      t  =  1,2,..., 

i  =  1, . . . ,n 

where  the  vector  of  the  number  of  people  to  be  hired  into  the  states  in  grade   i 
each  period,   f.,   is  specified  from  the  equilibrium  model. 


Define, 


Sl(0)  =  fxNr 


Then  using  (12)  it  is  easy  to  show  that 


s  (t)  =  f  N   for  all   t. 
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Thus,  from  the  theorem 


Sl(t)  =  s1(t)  +  (s1(0)-s1(0))M11(t) 
=  f^  +  (s1(0)-f1N1)Qj. 
Now  recursively  define, 

Sl  =  8l^    =  flNl» 

7.    =    (f.+s~.  nP.  JN.,     i  =  2,...,n.  (14) 

1     l   l-l  l-l   i 

It  is  straightforward  to  verify  that  these   s.   satisfy  the  basic  stock 

equation  (12),  so  we  have  from  the  theorem,  when  f.(t)  =  f., 

si(t)  =7i  + J,  (sk(0)-\»"ki(t)' 

k=l 
The  steady-state  component  can  also  be  written, 

7±'X  fkW       1  =  1 n-  (15> 

k=l 
i 
Note  that   £   ^v\-   *s  a  non-negative   1  x  w.   vector,  so  the  limiting 

ii    K.  Kl  1 

k=l 
vector  of  stocks  in  grade   i  must  be  a  non-negative  combination  of  the  rows 

of  N. .   Thus,  in  general,  not  all  non-negative  1  x  w.   vectors  are  possible 

limiting  stock  vectors  under  constant  external  flows. 

2.   Linear  Growth  of  External  Flows. 

In  this  section  we  consider  the  case  in  which  the  number  of  people  hired 

into  each  state  increases  by  the  same  amount  each  period.   Such  a  hiring  policy 

may  not  be  natural  over  a  long  period  of  time,  but  it  may  provide  a  simple 

approximation  to  planned  hiring  policies. 

Let  the  1  x  w.   vector   f.   be  the  increase  in  the  number  hired  into 
i  i 

states  with  FC  i  each  period.   Then  the  external  flow  vector  for  FC   i  is, 
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f±(t)  =  tf±,     t  =  1,2,..., 
i  =  1 , ... ,n. 
Let, 

Let  the  vector  function  s..  (t)   satisfy  the  basic  stock  equation  (1), 

s^Ct)  =  s1(t-l)Q1  +  fx(t). 
Using  the  identity  N  Q  +1  =  N   one  can  show  that 

s^Ct)  =  tf^  -  NjQ^. 
Thus  from  the  theorem, 

S;L(t)  =  tf^  -  f1N]_Q1N1  +  (s1(0)+f1N1Q1N1)Q^. 
We  note  that  s..  (t)   is  of  the  form 


S;L(t)  =  tLx  +  C± 


where     L     =   f  J.      is  a     1   x  w.      vector, 


and     Cn    =  -fnN1Q1N1      is  a     1   *  w.      vector. 
1  1   11   1  i 


Consider   some   FC     i   t  {2,...,n}.      Suppose   that 

Vi(t)  ■  tLi-i  +  ci-r 

where  L.  n   and   C.  .,   are   1  *  w,  .   vectors, 
l-l        i-1  i-1 

Using  the  identity 

(tf .N.-f. N.Q.N. )Q.    +    (t+l)f.    =    ((t+l)f. N.-f. N.Q.N   ), 
ill   11   11  i  111111 

one  may  show   that   if 

7.(t)    =   tf.N.    -    f. N.Q.N.    +7.    ,(t-l)P,    ,N     -   L        P      JQH, 
i  li  i   li   i  l-l  i-l   i  i-l   i-i   ill 
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then  s.(t)   satisfies  the  basic  stock  equation  (12).   Note  that   s.(t)   has 


the  form, 


where, 


s.  (t)  =  tL.  +  C. , 
1        1    l 


L.  =  f.N.  +  L.  nP.  .N. 
1     IX     l-l  l-l  1 


and, 


=  (f.+L.  -P.  -)N.,  (16) 

l   l-l  l-l  l 


C.  =  -(f.+L.  ,P.  _)N.Q.N.  -  (L.  .-C.  .)P.  _N. 
l      l   l-l  l-l   li  l     l-l   l-l   l-l  l 


=  -((L.   -C.  n)P.  .  +  f.N.Q.)N.. 
l-l   l-l   l-l    l  11   l 

Thus  we  have  shown  that  when  the  external  flows  grow  linearly  the  steady-state 

component  of  the  stocks  also  grows  linearly. 

By  recursive  substitution  in  (16)  we  have, 

i 

L .  =   J"   f .  B.  .  N .  . 
l   ,  *-,   k  ki  l 
k=l 

Note  that  this  vector  gives  the  expected  number  of  visits  to  states  with  FC 

i  of   f,  =  f,  (t+1)  -  f,(t)   entrants  with  FC  k,   k  =  l,...,i.   That  is,  the 

growth  in  the  stocks  with  FC  i  each  period,   L.,   equals  the  expected  number 

of  visits  to  FC  i  of  the  growth  in  the  external  flows  each  period  in  the 

FC's  less  than  or  equal  to   i. 

Both  L.   and  C.   have  the  fundamental  matrix  N.   as  a  right  factor, 
11  l 

so  the  steady  state  component  of  the  stock  vector,   s.(t)   must  be  a  non- 
negative  combination  of  the  rows  of  N..   This  same  result  was  observed  in 
the  case  of  constant  external  flows. 

In  summary  we  have  shown  that  by  choosing 

s. (t)  =  tL.  +  C. 
l        l    i 
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where 


L.  =  f,N,   when   i  =  1, 
1    11 

=  (fi+Li-lPi-l)Ni'     i  =   2>---»n> 

and 

C.  =  -f,  N.Q.N,   when   i  =  1, 
l     1  11  1 

= -((Li-rci-i)pi-i+£iNiVNi>       i-2.....n, 

then  from  the  theorem  the  stock  equation  may  be  written 


i 
s.(t)  =  s.(t)  +  I      (sk(0)-swk(0))Mk.(t) 
k=l 


3.   Geometric  Growth  of  External  Flows. 

In  this  subsection  we  show  that  geometric  growth  of  external  flows  leads 
(eventually)  to  geometric  growth  of  the  stocks.   We  consider  the  case  in  which 
the  external  flows  into  the  states  in  grade   i  are  proportional  to  a  known 
vector   f.   and  grow  geometrically  at  a  rate  6..   Thus, 

f.(t)  =  ejf.,      t  =  1,2,..., 

i  =  1,. . .  ,n 

9.  >  0. 

l 

When  0  <  0.  <  1,   the  external  flows  contract  rather  than  grow. 

If   9,   is  not  an  eigenvalue  of  Q.   for  k  ^  i  ^  n  we  may  define, 

k 
If  the  states  in  grade   i  have  the  0-1  visiting  property  then  all  eigenvalues 

of  Q.   are  zero  and  thus   6,  >  0   is  never  equal  to  an  eigenvalue  of  Q.   in 
i  k  i 

this  case. 

The  following  identity  will  be  useful: 
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w  ■  I  (f  vr 


Define. 


r=0   k 


W«i  =  \  I  (i  Vr+1 

r=0   k 


-ek(-i«l(ek)). 


Sl(9)  =  ^VV* 


Then  it  can  be  shown  that  if 


sx(t)  =  e^f1N1(e1), 

then   s  (t),   t  =  0,1,...,   satisfies  the  basic  stock  equation,  and  from  the 


theorem, 


S;L(t)  =  eif1N1(Q1)  +  (s1(0)-f1N1(61))M11(t) 


Note  that  the  steady-state  component  of  the  FC  1   stock  vector  grows  geometri- 
cally at  the  same  rate  as  the  external  flows  into  FC   1. 
Define, 

i-1 

B.  .  (8,  )  =  n   (N  (8.  )P  ) ,     1  *  k  £  i  £  n. 
ki  k      ,    m  k  m 
m=k 

Then  it  can  be  shown  that  if 

7iM  -  X  er(i~k)fAi(vw 

k=l 

then   s.(t),   t  =  0,1,...,   satisfies  the  basic  stock  equation  (12).   Note  that 

in  the  limit  the  stocks  with  FC  i  grow  geometrically  at  the  rate  of  the 

largest   8.   where  k  ^  i. 
k 
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Define, 


eM  =  max{6k;  k=l, . . .  ,i}, 


The  steady-state  component  of  the  stock  vector  is  not  in  general  a  non-negative 

combination  of  the  rows  of  N.   (as  was  the  case  with  constant  external  flows 

1 

and  linear  growth  of  external  flows).   Rather  the  steady-state  stock  distribu- 
tion is  a  non-negative  combination  of  the  rows  of   N.(9  ).   The  rows  of  N.(6  ) 
need  not  be  non-negative  combinations  of  the  rows  of   N.,   so  the  limiting 
stock  distributions  that  are  possible  under  geometric  growth  of  external  flows 
need  not  be  the  same  as  the  limiting  stock  distributions  under  constant  external 
flows  and  linear  growth  of  external  flows. 
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Yale  University 

New  Haven,  Connecticut   06520 

Professor  Abraham  Charnes  1 

Department  of  Mathematics 
University  of  Texas 
Austin,  Texas   78712 

Professor  David  Gale  1 

Operations  Research  Center 
University  of  California 
Berkeley,  California   94720 

Dr.  L.  B©za  1 

Bell  Telephone  Labs 
Holmdel,  New  Jersey   07733 

USA  Concepts  Analysis  Agency  1 

Attn:   MRD  (Major  Anderson) 
8120  Woodmont  Avenue 
Bethesda,  Maryland   20014 

Dr.  Eric  Wolman  1 

Bell  Telephone  Labs  2B419 
Holmdel,  New  Jersey   07733 

Professor  Kneale  T.  Marshall  10 

Department  of  Operations  Research 

and  Administrative  Sciences 
Naval  Postgraduate  School 
Monterey,  California   93940 
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Deputy  and  Chief  Scientist  (Code  102)  1 

Office  of  Naval  Research 
Arlington,  Va.   22217 

Assistant  Chief  for  Research  (Code  iiOO)  1 

Office  of  Naval  Research 
Arlington,  Va.  22217 

Director  of  Research  (Code  U01)  1 

Office  of  Naval  Research 
Arlington,  Va.   22217 

Manager,  Program  in  Manpower  RAD  (Code  h$0)  15 

Office  of  Naval  Research 
Arlington,  Va.  22217 

Defense  Documentation  Center  12 

Building  5> 
Cameron  Station 
Alexandria,  Va.   2231k 

Chairman,  Planning  Committee  for  the  1 

Program  in  Manpower  R&D  (Code  li30) 
Office  of  Naval  Research 
Arlington,  Va.  22217 

Director,  Naval  Applications  and 

Analysis  Division  (Code  1|60)  1 

Office  of  Naval  Research 
Arlington,  Va.   22217 

Research  Psychologist  1 

Office  of  Naval  Research  Branch  Office 
536  S.  Clark  Street 
Chicago,  IL  6060$ 

Psychologist  1 

Office  of  Naval  Research  Branch  Office 
U95  Summer  Street 
Boston,  MA  02210 

Psychologist  1 

Office  of  Naval  Research  Branch  Office 
1030  E.  Green  Street 
Pasadena,  CA  91106 
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Deputy  Chief  Scientist 

Office  of  Naval  Research  Area  Office 

207  West  2Uth  Street 

New  York,  NY  10011 

Head,  Manpower  Training  and  Reserve 

Group  (0p-96UD) 
Room  UA£3ft,  The  Pentagon 
Washington,  DC  20350 

Assistant  to  the  Assistant  Deputy  Chief 

of  Naval  Operations  (Manpower)  (0p-01CZ2) 
Room  2633,  Arlington  Annex 
Washington,  DC  20370 

Deputy  Director,  Program  Management  Office 
Naval  Material  Command  (03PB) 
Room  868,  Crystal  Plaza  #6 
2221  Jefferson  Davis  Highway 
Arlington,  Va.  2C360 

Program  Administrator,  Personnel  and 

Training  Support 
Naval  Material  Command  (03i;2U) 
820  Crystal  Plaza  #6 
2221  Jefferson  Davis  Highway 
Arlington,  Va.   20360 

Technical  Director 

Navy  Personnel  Research  and  Development  Center 

San  Diego,  CA  921$2 

Assistant  for  Research  Liaison 
Naval  Bureau  of  Personnel  (Pers-12) 
Room  lhl6,  Arlington  Annex 
Washington,  DC  20370 

Senior  Research  Coordinator 
Naval  Bureau  of  Personnel  (Pers-12t) 
Room  lUl6,  Arlington  Annex 
Washington,  DC  20370 

Special  Assistant  for  Enlisted  Force  Analysis 
Naval  Bureau  of  Personnel  (Pers-2x) 
Room  2628,  Arlington  Annex 
Wasnington,  DC  20370 
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Head,  Program  Development  and  Coordination  Branch 
Naval  Bureau  of  Personnel  (Pers-22£) 
Room  2606,  Arlington  Annex 
Washington,  DC  20370 

CAPT  James  J.  Clarkin 

Special  Assistant  to  the  Chief  of  Naval  Personnel 

(Pers-Oe) 
Room  2U03,  Arlington  Annex 
Washington,  DC  20370 

Director  for  Manpower  Research 
Office  of  the  Secretary  of  Defense 
Room  3D960,  The  Pentagon 
Washington,  DC  20301 

Assistant  Director  for  Environmental  and 

Life  Sciences 
Office  of  the  Director  of  Defense  Research 

and  Engineering 
Room  3D129,  The  Pentagon 
Washington,  DC  20301 

Military  Assistant  for  Human  Resources 
Office  of  the  Director  of  Defense 

Research  and  Engineering 
Room  3D129,  The  Pentagon 
Washington,  DC  20301 

Special  Assistant  for  All  Volunteer  Force  Action 
Office  of  the  Assistant  Secretary  of  Defense 

(Manpowor  and  Reserve  Affairs) 
Room  20270,  The  Pentagon 
WAMh  Lngton  ,  ix:  20301 

Research  Study  Director 
MI  3101 

Smithsonian  Institution 
Washington,  DC  20560 

Dr.  Albert  S.  Glickman 
American  Institutes  for  Researcn 
Q$$$  -   16th  Street 
Silver  Spring,  MD  20910 

Dr.  Henry  Solomon 
The  George  Washington  University 
Department  of  Economics 
Washington,  DC  20006 
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Prof.  Robert  M.  Oliver 
University  of  California 
Operations  Research  Center 
Berkeley,  CA  9U720 

Dr.  David  G.  Bowers 
University  of  Michigan 
Institute  for  Social  Research 
Ann  Arbor,  MI  U8106 

Mr.  Michael  W.  Brown 
Operations  Research,  Inc. 
lhOO  Spring  Street 
Silver  Spring,  MD  20850 

Mr.  Philip  G.  Bernard 
B-K  Dynamics,  Inc. 
2351  Shady  Grove  Road 
Rockville,  MD  208$0 

Dr.  Anita  S.  West 
Denver  Research  Institute 
University  Park 
Denver  Colorado  80210 

Dr.  Gloria  L.  Grace 

System  Development  Corporation 

2500  Colorado  Avenue 

Santa  Monica,  CA  90U06 

Dr.  Barry  M.  Fe inhere 

Bureau  of  Socia]  Science  Research,  Tnc. 

D990  M  Street,  NW 

Washington,  DC  20036 

Dr.  David  A.  Schrady,  Chairman 

Dept  of  Ops  Research  and  Admin  Sciences 

Naval  Postgraduate  School 

Monterey,  CA  939UO 

Dr.  Marvin  Dunnette 
Personnel  Decisions,  Inc. 
2515  Foshay  Tower 
Minneapolis,  MN  55U02 

Dr.  Herbert  R.  Northrup 
Wharton  School  of  Finance  &  Connerce 
University  of  Pennsylvania 
Philadelphia,  PA  1910k 


44 


ACTIVITY  COPIES 


Prof.  Ezra  S.  Krendel 
Department  of  Operations  Research 
University  of  Pennsylvania 
Philadelphia,  PA  19101; 

Dr.  Allan  H.  Fisher,  Jr. 
Human  Resources  Research  Organization 
300  N.  Washington  Street 
Alexandria,  VA  22311; 

Mr.  Will  E.  Lass iter 
Data  Solutions  Corporation 
£272  River  Road,  Suite  100 
Bethesda,  MD  20016 

Scientific  Advisor  for  Personnel  Systems 

AF/DPXYA,  Headquarters  USAF 

Room  £C360,  The  Pentagon 

Washington,  DC  20330 

Attn:  Maj.  John  D.  Johnston 

Technical  Director 

U.  S.  Army  Research  Institute  for  the 

Behavioral  and  Social  Sciences 
1300  Wilson  Boulevard 
Arlington,  VA  22209 
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